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A'^STBACT 

This report dealing" with the procesjs of attitude 
change stimulated by social studies material is dii^ided into two 
parts. Part 1 surveys the literature on attitude formation in four 
methodological categories: prescriptive teaching strategies; 
pre/post, guasi -experimental test approach; content analysis; and 
experimental method approach. Special attention is given to the last 
two methodologies. The section on content analysis includes matrices 
to describe five studies on the content of social studies curriculum 
materials* The section on experimental method in information 
integration, which seeks to determine the conditions leading to 
attitude change, concentrates on an analysis of a state adopted 
textbook dealing with China in order to isolate concrete examples of 
attitttdinal and contextual values. Part 2 of the report describes the 
application of information integration theory to a study that 
isolates and quantifies student attitudes influenced by attitudinal 
and contextual values in social studies materials. The results of 
this study show that student impressions are functions of the 
cumulation of value loaded materials. These results underscore the 
importance of balanced messages in curriculum material and of 
teaching basic critical skills. The appendixes to the report contain 
bibliographies and data collected for the study. (JH) 
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SECTION I 



A GENERAL ASSESSTCNTT OF PRESCRIPTIVE AND EXPERIMENTAL STUDIES 
IN ATTITUDE DEVELOPTCNT REUTED TO SXIAL STUDIES EDUCATION 



This section seeks to illustrate and to assess the extent to which 
social studies educators and social psychologists have approached and 
studied the phenomenon of attitude fonaatlon and change. Specifically, In 
this section ve report the prescriptive developments and experimental findings 
which best define the indicators of attitude formation and change. The 
literature in social studies education is the primary focus of this review 
because of two underlying assumptions: (1) social studies curricula is 
instrumental to the transmission of much of the general system of values 
and generation of attitudes about our society and world community; and 
(2) teaching strategies adopted by social studies teachers may directly 
affecn the formulation of such attitudes and opinions by the learner. 



1 

Introduction to Literature 



A perusal of social studies methodology textbooks indicates a long and 
substantial normative tradition of clarifying and evaluating altitudes and 
values. For example, when teaching attitudes to develop democratic citizenship 
(Gross and Zeleny, 1958), educators have stressed the need for assessment of 
personal values (Shaftel and Shaftel, 1967; Raths et al., 1966: Simon et al., 
1972) and societal values (Hunt and Metcalf, 1968; Bloom et al., 1971). The 
'new' curriculum changes in the 1960 's, furthermore, emphasizea the social 
science disciplines and the inquiry learning skills for evaluating decisions 
ana formulating policies principally at thfc community and societal level 
(Michaelis and Johnston, 1965; Oliver and Shaver, 1966; Massialas and Cox, 
1966; Fenton, 1967; Gross and Muessig (eds.), 1971). 

There have been numerous studies in recent years systematically classifying, 
sorting, and describing attltudinal information in social studies textbooks 
according to the exclusion and/or inclusions of major themes or key words 
(Michigan Study, 1973; Fox, 1972; McDlarmid and Pratt, 1971; Banks, 1969). These 
St dies were primarily motivated by the assumption that the content of many 
textbooks was biased and distorted and that, because textbooks serve as the 
major instructional tool, they greatly affect the formation of attitudes 
in school children. 
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For the past three decades, social psychologists and communications 
theorists, too, have conducted exp<iriments to investigate which parameters 
affect the formation and change of attitudes. Some of the Important factors 
identified were: 

1, the structure of the information; 

Examples of this area of research concern include various media 
presentations (Bond, 19A0; Berelson, 19A2; Movland, Lumsdaine and 
Sheffield, 1957; Mitnick and McGinnies. 1958); authority and status of 
communicator (G.I. Hovland and W. Mandell, 1958; Asch, 1948); incompatible 
cognition (Kelman and Hovland, 1953); and internal consistency (L. 
Festinger, 1957). 

2, the context in which the information is presented; 

This research approach focused on emotional factors (I.L. Janls and 
S. Feshbach, 1953; Radelflnger, 1963); reference groups (Kelley and 
Volkart, 1952; King and Janls, 1956; Siegel and Siegel, 1957); personality 
Impressions (Altman and McGinnies, 1960; Schmidt, 1969); and primacy 
a\id recency effects (Anderson and Hovland, 1957; C,l. Hovland, 1957; 
liyrne et al., 1969) . 

3, the attitudlnal integration of the information. 

Specific empirical procedures were developed for scaling and rating 
attitudes (Edwards and Kllpatrlck, 1948; Hovland and Sherif, 1952) and 
for observing decision making processes (Shanteau, 1970a, b). 

In general, these researchers attempted to determine whether, and to 
what extent (a) a specific kind of commun' ,'ation influenced the formation of 
attitudes; (b) the subject's predisposition Intluenced attitude change; and 
(c) t'.ve conditions of the persuasive information affect attitude change. 
More recently, many theorists have begun to explore how psychological processes 
of cognition (e.g., cognitive consistency. Imbalance, congruity, contrast 
dissonance) are related to attitude change and learning theory (Feather, 1964, 
1967; Tannenbaum, 1967; Sherif and Hovland, 1961; Sherif, Sherif and Nebergall, 
1965) . 

Paralleling the prescriptive-descriptive writings of the social studies 
educators, other curriculum researchers have tested certain treatment effects of 
curriculum materials, specifically the structural presentation effects of 
curricular materials. A classic example is Bond's 1940 study In which he 
manipulated materials in a genetics course in an attempt to influence attitude 
change toward national groups, race, and Imperialism (recall that this study 
was done In 1940). Ke found that by emphasizing authoritative generalizations 
about people from the subject matter of genetics, he could produce greater 
understanding of the generalizations and also induce posltivs attitude change 
toward national groups, race, and Imperialism. On the other hand, other studies 
(e.g., Williams, 1948; Stevenson, 1955; Lagey, 1956) have shown that the 
content of a course dees not guaranteti that students' attitudes will change 
on the topics being studied. Thus, th^ evidence for attitude change as a 
function of treatment effects has been inconclusive; and the choice of teaching 
strategies for influencing positive attitudes remains unclear. 
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While much of the work uy social psychologists and curriculum researchers 
has been bosed on the assumption that the information a learner encounters 
is the pricary determinant of attitude formation, recent studies in information 
integration have postulated that the evaluative load of information (the value 
of favorablencss of the information) is the crucial factor (e.g., Qp-^od and 
Tannenbaum, 1955; Abelson and Rosenberg, 1958; Fishbeln and Hunter, '^64; and 
N.H. Anderson, 1969). The information integration theorists postulate that 
attitudes (or more appropriately, impressions) ordinarily result from an 
accumulation of evaluative Information and evidence. This simple, but fundamental 
fact, they claim, is illustrated by reflecting on the development and 
change, over a period of time, of one's impression/attitude toward particular 
friends or toward one's job. The same holds for opinions about political 
figures or about social problems such as conservation, bussing, and drugs. 
More prt?cisely. 

Information stimuli continually impinge on the person, in life or 
in the laboratory, and he must integrate them with one another as 
well as with his prior opinions and attitudes. (For example), si'cial 
judgiaents are typically based on a cumulation of various pieces of 
information, sometimes of the most diverse nature. Factual and 
hearsay evidence, rumors, prestige associations, gestures and 
appearance, may all bear on the final attitude. Information integration 
is thus fundamental in attitude change (Anderson, 1970b). 

One of the most cogent and comprehensive experimental approaches for 
analyzing the process by which information is integrated has evolved from the 
work by N.H. Anderson (1968a, 1972). For the past ten years, he has studied the 
conditions undtir which information is accepted or rejected and the effects of 
context factors on attitude impression formation. His theoretical work ranges 
from personality Impression (Anderson, 1965a), including studies of hetero- 
geneous stiiiiuli (Lampel and Anderson, 1968), primacy effects (Anderson, 1965a), 
serial presentation (Anderson, 1968b, 1973b), set-size effect (Anderson, 1967), 
stimulus inconsistency and discounting (Anderson and Jacobson, 1965), and 
averaging versus adding model (Anderson, 1965b, 1968a), to work in psychophysical 
judgments (Weiss and Anderson, 1969), decision making (Shanteau and Anderson, 
1969), learning (Anderson and Hubert, 1963; Anderson, 1969), and attitude 
change (Sawyer and Anderson, 1971; Anderson, 1973a). 

Information integration theory hypothesizes that (1) the attitudinal 
value of the message can be defined by two parameters, its scale value and 
its weight value. The scale value reflects the position of the massage on a 
scale of judgment, indicating its degree of f avorableness or unfavorableness. 
Varying degrees of favorableness may be assessed according to the range of the 
scale. For example, a message may be judged to be highly favorable, moderately 
favorable, moderately unfavorable, or highly unfavorable, using a four-point 
scale for the judgments. 

The weight value, on the other hand, reflects the value on a scale of 
judgment of the source or context in which the message is presented. Varying 
degrees of appropriateness of the source of message may be assessed according to 
the range of the scale. For example, the source of the message may be judged to 
be highly reliable (factual) or highly unreliable (subjective), using a four- 
point scale; and 
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\2) there are specific rules to define hov Information within and 
betweeti messages is integrated to form an overall impression, Anderson offers 
two rules for information integration. The fivst rule states that the 
favorableness of the messages (scale value) are added together to form a 
generxil impi ession. This model, called the adding model, assumes that the 
value of thvi sources (weight value) is recognized but is not used In forming 
the general impression. The following equation represents this model: 

R = C + + 

where R is the resultant general impression, G is a constant that may or may 
not represent the subjects' attltudinal predisposition, w^ is the weight value 
of the source (equal to zero), and s^ is the scale value for degree of favorable- 
ness of the message. 

The second rule states that the favorableness of the message (scale value) 
and the favorableness of the source (weight value) are weighted or averaged 
to form the general impression. This model is called the averaging model and 
Is represented in the following equation: 

R = C + w^ ^i'^^i 

when R, the resultant general impression, is mathematically equivalent to the 
sum of the products of the weight taimes scale values divided by the sum of the 
weights*'. 

Most of Anderson's experiments seek to distinguish whether the subject 
is (a) adding the scale values or (b) awraglng them. To explain this 
relationship between scale and weight values, Anderson provides a linear model 
as follows: 

R = C + Wj^ 

where R is the judgment response, C is a constant, and w^ and Sj are the weight 
and scale value of the ith message In a set (Anderson, ly68a, 1970). 

The work of Anderson and others in information integration offers one of 
the most promising and appropriate research approaches for the curriculum 
researcher. 

2 

Illustration of Prescriptive and 
Experimental Studies 

In revie;ang the literature, there appear to be four distinct methodo- 
logies for srudying attitude formation: (1) development of prescriptive 
teaching strategies; (2) content analyses to raise Issues about the existence 
and pervasiveness of negative social attitudes present in social studies 
textbooks; (3) pre post, quasi-experimental tests to assess the effects of 
structure and context of information on attitude change; and (4) experimental 
designs to test attitudinal integration of information. 
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Pr escriptive T ^ ^ hlT^g Studies. The most volvuninous category of publications 

iu social studi^"? education pertinent to attitude development and change is camposed 

of methodology , txtbooks which seek to guide the teacher in identifying 

appropriate inst ructional objectives (Bloom, 1971)5 approaches to subject 

matter dlsciplint^ (Krug et al*, 1970; Morrlssett, 1967); selection of curriculum 

materials (Krug, 1)0; Fenton, 1967; Hunt and Metcalf, 1968; Oliver and Shaver, 

1966); and ins true U^nal techniques (Raths et al., 1964; Shaftel and Shaftel, 

1967; Simon, 1972) Such methodologies are directed toward the attainment of 

democratic citizenship competencies, personal value clarification, and 

reflective thinking. The Intent of such methodologies is to "develop attitudes 

of respect for the w srld and dignity of the Individual as a human being, of 

social and civic rcs;Hmsibllity, and of respect i:5r truth and logical means 

of arriving at concisions" (in Gross and Zeleny, 1958), 

The evaluation o ' attitudinal change is also presented using prescriptive 
techniques (e.g., use of obse*-vatlon, pencil and paper inventories, soclo- 
drama, etc.), Severa: books refer to general research findings which support 
some of their prescrip lions. For example, Raths (1966) reviews numerous 
treatment and survey studies which used value clarification, directive counseling, 
or role playing technlr^ues. However, the process of attitude formation was 
only considered in tex-as of descriptive procedures rather than the actual 
content of the Inform*' tion. 

Essentially, the standard social studies teaching methodology texts have 
reflected the studief of attitude development and change in social psychology and 
other relevant field , of study; however, they have not suggested systematic 
approaches for teach irs to evaluate the effects of teaching methods and materials. 

Content Analysis. < ontent analysis is a popular form of curriculum research in 
social studies educ-.tion. The factual content of social studies curricula has 
been a continuing c-ncern of content specialists in the various subject 
areas, while the ef ect of presenting materials has been the concern of the 
communications expert and, of course, of the teacher as the prime communicator in 
the classroom. Reasarch in content analyses has combined these concerns and 
investigated the irteraction between content and communications and how it 
affects the determinants of the learner^ s attitudes. 

In Table 1, a review of the methodologies, of f ive content analysis studies 
of social studies naterials is provided. These studies were selected as 
representative exanples of social studies analysts' attempts to supply evldenc£ 
of negative attitudes or the nonappearance of positive social attitudes in 
textbooks and to identify the determinants of attitudinal effectf*. 



Insert Table 1 



Table ii provl. «s this author's assessment of the usefulness and effectiveness 
of these studies fo; identifying the context of the communication and their 
possible effects. 1 ach study has been analyzed using the following assessment 
indicators. 
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1 — descriptive power of the unit (e.g., key work, themes); 

II — representativeness of the material (e.g., sampling procedure); 

in — descriptive power of the content c ategories (e.g., treatments); 

IV — evaluative loading of the information unit (e.g., positive/ 
negative); 

V <— • supportive evidence of the information unit (e.g., factual/ 
subjective); 

VI — Inferential power of the data analysis results ; and 

VII — appropriateness of inferences .and recomnendations based on the 
analysis. 
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Based on Tables i and 11, the following conclusions are proposed: 

I, Descriptive Power of the Unit. Content analyses seek to classify content 
as systematically as possible. The purpose is to describe the values and 
connotations of the message contained in each unit of analysis. 

A content analysis technique which Includes the context in which main 
concepts are presented as part of the unit of analysis will presumably have 
more descriptive power than those that do not. For example, the California 
Task Force Report (1971) uses key words (e.g., Asian Americans, race) as the 
unit of analysis. 1 These key words, however, are not systematically selected, 
nor do they Include the context within which they are used. The Banks study 
(1969) uses themes (e.g., discrimination) as the unit of analysis, selected by 
a systematic procedure; however. It does not cla«slfy these themes using the 
context provided within the textbook chapters. The Fox (1972) and McDlarmld and 
Pratt (1971) studies, on the other hand, were more context-oriented, since 
complete paragraphs and complete textbooks, respectively, rather than single 
words or phrases, were used as the unit of analysis, 

II. Representativeness of Materials Used . All of the content analysis 
studies applied an objective and comprehensive system for selecting materials, 
with the exception of the California Task Force study. Ideally, a sampling proce- 
dure should be applied to obtain a representative sample of social studies 



ht should be noted that the California Task Force Report is not under 
negative criticism in this review. One author, a former member, clearly 
realizes the constraints of time and purpose under which this group had to 
operate. This Report is Included only to permit comparisons between various 
content analysis procedures. 
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materials to be analyzed. This procedure may guarantee the generalizability 
of tho findings to other social studies texts. For eicample^ Fox and McDlarmid 
and Pratt used a sampling procedure to select social studies textbooks which 
wer*. on static-adopted lists* Preselected criteria^ however^ were used to 
select units within the textbooks* 

111* Descriptive Power of the Content Categories* Most of these studies use 
only a priori criteria to determine the categories to he used for the content 
analysis. This procedure generally excludes from the analysis information that 
does not fit these categories. The investigators using this procedure obviously 
assumed that such information would have no effect on the results and inter- 
pretation of the content analysis* 

IV. Evaluative Loading of the Information^ Cne of the most important aspects 
upon which the content analysis should focus is the amount of positive 
(favorable) or negative information pre8en*:ed in the unit of analysis* The 
authors believe this i;^ a crucial indicator which should be studied in order 

to answer the questions posed for these studies* The majority of the researchers 
have obscured or embedded this indicator in other variables such as content 
(l.e,^ treatments)* Only Fox and McDlarmid and Pratt (Study f/B) attempt to 
isolate this indicator explicitly • Fox assesses whether or not the textbook 
authors* opinions toward social conflict factors are favorable; and McDlarmid 
and Pratt apply a sophisticated evaluative assertion analysis to determine the 
presence of favorable sentences in each content category* 

V, Supportive Evidence for the Information^ Another indicator upon which 
content analysis studies should center is the qualitative relevance of the informa* 
tion presented in each unit. This quality could be operationally defined by 

the degree of objectivity or subjectivity of the source of information (e.g*^ 
factual or judgmental information)* Only McDlarmid and Pratt (Study f/A) 
attempt to assess this kind of supportive evidence. They use five categories 
of criteria (e.g^^ validity— accurateness^ unambiquity; concreteness—objectivity, 
factual > realistic; etc.) to determine how well the textbook material fit their 
standards. 

VI ^ Inferential Power of the Data Analysis Results* Since most of these studies 
use some type of statistical technique for data analysisi it is iniportant to 
determine the types of inferences that the results of these analyses do or do 
not guarantee* Two main statistical models are used^ namely, chi-square and 
analysis of variance. Ghl-square analysis, appropriate for the analysis of 
frequency data^ is useful to identify globally significant differences between 
content categcrles used in the studies* However, unless specific chl'^square 
techniques for partitioning the variance are used^ the common chi-square 
analysis does not permit comparisons among specific categories* For example, if 
a study uses the following categories in the content analysis: (a) Christians, 
(b) Jews, and (c) Moslems; a chi-square test of significance will allow us 
to infer that the differences between categories a, b, and c are statistically 
significant. However, it will not give us infonnation necessary to answer the 
following questions: 

(1) is 'a' significantly greater than 'b'?; 
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(2) is 'a' significantly greater than ^c^?; and 

(3) is significantly greater than 'b*? 

Banks usos chl-square analysis to test that the frequency of *Vacial violence 
and conflict" will be significantly greater than for 'Vacial harmony*" However, 
in his study t there are eleven categories « 

One-way analysis of variance Is another statistical procedure conmonly 
used in these studies* This procedure is useful to test the statistical signifi- 
cance of both global and specific comparisons. Furthermore > factorial analysis 
of variance, using principles of experimental design, permits testa for statistical 
significance of combinations of factors or categories (interactions). These 
significance tests are based not on total or partial frequencies, but on 
frequency or percentage means, computed by dividing the frequency within a given 
category by the number of .categories ,2 pox and McDiarmld and Pratt, Study #B, 
apparently used one-way analysis of variance. Fox compared differences 
between grades and social conflict categories « One of his conclusions was that 
there is a significantly higher frequency of social conflict issues in fifth 
grade textbooks than in third grade or ninth grade books , McDiarmld and Pratt 
used evaluative assertion formulas to generate their mean raw scores. They 
then applied analyBls of variance to compare whether or not there were statistically 
significant differences between treatments, textbooks, grade levels, subject 
matter, publishers, date of publications, language, sex of author, and 
number of authors. They found differences between treatments and textbooks. 

Vll. Appropriateness of Inferences and Recommendations. In making inferences, 
most of these studies overlooked both the limitations of content analysis as 
a technique and the limitations of the statistical procedures used in the data 
analysis. In his review of content analysis studies, Berelson (1954) stated 
that ^^the effects of communication cannot be inferred directly from the attributes 
of content (Vhat^) or style ('how') without Independent validation/* On the 
other hand. Inferences based on the results of the study cannot be drawn beyond 
what is guaranteed by the statistical procedures. In order to assess the 
appropriateness of conclusions and recommendations, the following questions may 
be asked: 

(1) Are the units of analysis randomly selected so that generalizabillty 
will be guaranteed? 

<2) Are the scoring procedures for quantifying the data reliable? 

(3) Is there any infoniiation regarding the construct validity of the 
categories used in the content analysis? 



■^For a detailed explanation of the type of comparisons used with 
analy3i9 of variance, see Part 3 in this section. 
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(4) Are the statistical procedures used appropriate for the kind of 
data collected? 

(5) Are the comparisons between categories/treatments statistically 
independent? 

(6) Are the levels of 5,tatistlcal significance appropriate? 

(7) Are the inferences based on comparisons allowed by data analysis 
procedures? 

To fulfull Berelson^s validity requirement^ it seems necessary to use further 
experimentation for validating the results obtained by content analysis techniques • 



Pre Post^ Quasi-experimental Test Approach. The objective of most curriculum 
researchers^ using the pre/post test approach, has been to investigate some 
of the structural factors uf curricula materials which are thought to affect 
attitude change^ The basic methodological assumption Is that attitude change 
can be attributed to the effects of content stimuli by measuring a student's 
predispositions on a pre test and the effects of treatment presentation on a 
posttest* For purposes of illustration, two typical curriculum studies will be 
reviewed « 

Fisher (1968) was interested in looking at the influences of reading and 
discussion on fifth graders* attitudes toward American Indians^ He tested 
a null hypothesis that persuasive communication in reading materials of a 
literary nature would effect no change on childrens^ attitudes toward American 
Indians* Also, he hypothesized that the predisposition of the students would 
not influence an attltudinal change* The design controlled for a subject factor 
(socioeconcmic background) and two treatment factors {groups anc reading materials)* 
There were three treatment groups: experimental group #1 (reading only), 
experimental group ^f2 (reading plus discussion)^ and a control group (no 
reading or discussion)* Students were pretested on an attitude Information 
test to determine whether, and to what extent, they were prejudiced toward 
American Indians. Students, by classrooms, were assigned to treatment conditions. 
Over a three-week period, the experimental groups read six selections* At 
the end of the study, the three groups were given the same attitude Information 
test as a post test* The researcher concluded that the null hypothesis had to 
be rejected. Significant reductions in prejudice, as measured by the attitude 
information test, were produced In both experimental groups, the groups that 
had read the six literary readings. The predisposition of the students had no 
bearing on the reduction in prejudice which was attributed to the kind of 
experimental treatment. The group with reading and discnssion showed more 



"^Donald Campbell and Julian Stanley (1963) use this term to describe 
experimental designs which lack optimal control but are worth undertaking 
where better designs are impossible (71). 
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change in attitude than reading alone« 

Litcher and Johnson (1969) conducted a similar study on attitut^^i change 
associated with the use of multiethnic readers • They hypothesized i.hat the 
persuasive connnunication in multiethnic readers , which associated Negro with a 
positive response identified with 'middle class' characteristics, would have no 
change effect on children's atf^tudes toward Black Americans, T» .2 researchers 
manipulated two treatment groups: the experimental group (with multiethnic 
readers) and the control group (with regular readers). The experimental procedures 
required students to be interviewed individually in order to be given four 
pre tests (i.e^, Clark Doll Test, Show Me, Categories Test, and Direct Com- 
parisons Test). The experimental group used the multiethnic readers for four 
months in a normal classroom setting, while the control group used the regular 
readers. The post test was administered at the end of the study, using the same 
attitude tests and procedures as in the pretest. Based on the results of the post 
tests, students of the experimental group responded with a more favorable 
statistically significant frequency toward Negroes than the control group. The 
authors concluded that their counter-condition hypothesis was supported and that 
the social perception and social learning hypotheses were rejected. That is, 
they claim that increased visibility of ethnic minority groups In reading 
materials would reduce prejudice and Increase racial harmony. 

In cn attempt to assess the appropriateness of the pre/post, quasi^ 
experimental test approanh, it seems quite evident that these kinds of studies 
can only ask if the experimental treatments affect the subjects' attitudes. 
Studies like this usually find that some degree of negatlvlum, as measured by the 
attitude test, is reduced and that such a reduction in negativism is not 
related to predisposition but to the kind of experimental treatment. Long- 
term effects are rarely found. The actual experimental conditions in terms of the 
newness of the materials, the exclusiveness of the study, the lack of control of 
some of the more complex contextual factors contained in materials (e.g., the 
lack of control of the effects of positive and negative loading of information) 
point to the limitations of such pre/post test studies. No attempt is made to 
isolate those factors which may actually account for what and how Information Is 
processed which cause an attitude to change or be modified, especially over 
time. In addition, the statistical tests based on correlation coefficients have 
been criticized, since high correlations between model and data are typically 
built into the stimulus design (Sidowski and Anderson, 1967). 

Experimental Method Approach. A different research objective is applied for 
experimental work in information integration. In this case, the researcher seeks 
to determine the conditions under which information is processed (e.g., how the 
subject combines messages to form an overall impression). The methodological 
assumption is that the effects of information on attitude formation can be 
explained by manipulating the evaluative load of information (i.e., the degree 
of f avorableness) , order, and other contextual factors by using factorial 
designs, procedures of functional measurement, and analysis of variance 
(Anderson, 1970a). 

While no previous studies have been conducted by c^frrlcultun researchers 
applying integration theory, there are two particular studies done by social 
psychologists whlrh lend themselves to curricular concerns. Anderson (1973a) 
applied InfortQation integration theory to Identify how subjects form attitudes 
about U.S. Presidents. He assumes that attitudes develop and change as a person 
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receives new information and integrates it with his current attitude. To 
teat this, he manipulated two major stimuli which were thought to account for 
how a person evaluates and processes information. These factors are: 
(1) the attitudinal value or evaluative load of a message according to its 
degree of f avorableness; and (2) its significant source or contextual load of 
information (e.g., degree of f avorableness of the amount and reliability of 
the message). In this study, a factorial design was used to control only 
factual Information about eight U.S. Presidents and the serial order of the 
evaluative loads (e.g., H+H+H+H+, H-H-H-H-, L+L+L+L+, L-,L-,L-,L-, denoting 
highly favorable, moderately favorable, moderately uivfavorable, and highly 
unfavorable attitudinal values). 

Subjects were instructed to rate each President (on a ten-point scale) 
on his general qualities of statesmanship and how well he did his job, A 
simple additive model was hypothesized to account for the effect of the evaluative 
loads (favorable/unfavorable) on the subjects' impression ratings and the non- 
interaction effects of the contextual loads (amount and order of evaluative 
messages) . 

Analyses of variance were run, and the statistically significant results 
supported the integration model. Anderson, therefore, postulated that a 
subject's impressions are a function of the build-up or accumulation of favorable 
messages. That is, the addition of the amount of favorable information will 
increase the favorableness of the response, and such contextual factors as order 
and Importance of the Information are independent of the evaluative loads and 
thus will not interact with them. 

Kaplan and Kemmerlck (1972) ran a study concerning juror Judgments using 
the information integration model. In this experJinent, simulaced jurors were 
asked to give ratings of guilt and punishment for eight traffic felony cases 
which varied in type of evidence (e.g., evidential information which pertained 
directly to the alleged crime; and non-evidential information which related to 
the defendent's personal characteristics). According to information integration 
theory, a subject must combine or Integrate the information components into 
a unitary stimulus value (e.g., the defendent's likableness) . Consider the 
experimental task of the juror. He or she was provided with a message giving 
information about an alleged crime. Similar to the positive and negative 
stimuli presented in the U,S, President study (Anderson, 1973a), in this case, 
each message has a value on the dimension of guiltiness which had to be combined 
to make a judgment. 

The evaluative load again was found to function linearly end to combine 
noninteractively with types of evidence. That is, a negatively evaluated 
defendent will bias judgments against himself whether the evidence Is Incriminating 
or exonerating, and to the same extent. The reverse also held for positively 
evaluated defendants. 

The outcomes of these two experimental studies are very suggestive. First, 
they demonstrate that a simple additive model can account for a moderately 
complex cognitive process. Secondly, the fact that certain contextual factors did 
not Interact with the linear function of the evaluative load further isolates 
and emphasizes the Importance of looking at the evaluative load of messages for 
determining impression formation. And third, the stimulus judgments, particular- 
ly those found in the U,S. President study, are reasonably similar to social studies 
materials. This kind of laboratory work has direct implications for practical 
school problems of teaching and learning. 
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Information Analysis Procedure for Social Studies Materials 

The research evidence presented by infonnation integration theorists 
provides an exciting and promising approach to be used in the study of the 
effects of social studies textbook materials upon the learner. The authors 
planned a two-stage approach to empirically test the effects of written social 
studies materials upon impression formation* In the first stage^ an information 
analysis technique! was developed to isolate the factors which Identify the 
kinds of evaluative load and contextual load which are contained in printed 
instructional material. In the second stage^ an experimental study on the 
effects of these contextual factors upon impression formation was conducted to 
test the relevance of an application of the adding model postulated by Anderson 
(1972a) to social studies curriculum materials* A description of the information 
analysis' findings will be briefly reported in this chapter. 

Introduction * Using a classlf Icatory technique devised by one of the authors in the 
spring of 1972^ four Information analysis studies have been conducted* The 
objectives of these studies were: 

(1) to analyse objectively and systematically a unit of information 
within its message context; 

(2) to select general content categories which subsume all message 
units in a section of the textbook; 

(3) to classify all message units according to its evaluative load (e.g*, 
positive, negative attitudinal values)^ type of content categories, 
and supportive evidence (judgmental /factual); 

(4) to apply factorial analysis of variance to test significant differences 
between contextual factors and to identify order effects of message 
units; and consequently, 

(5) to provide the means for generating hypotheses about the possible 
effects of content parameters on the learner's attitude formation* 

One of the replicated studies on Voices of Emerging Nations will be 
reported here»^ The China section, consisting of twenty-four chapters, was 



"^This label is applied to eliminate confusion with the other content 
analyses reported in Section I* 

2 

This California State adopted textbook is a Leswing Communications 
publication (1971), and it is presently in the State Suggested List of Textbooks. 
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analyzed in Its entirety. This seventh grade social studies textbook (used 
also in ninth and tenth grade courses) was one of two which were selected 
based on a survey of six county offices of education in the local area to 
determine which textbooks were more frequently used in world civilization and 
world problems courses ♦ 3 

The information analysis scheme was devised to identify the key factors which 
are said to account for how information is integrated. It was decided that 
each message unit would be analyzed according to (1) Its evaluative load 
(neutral, negative, and positive values); (2) its supportive evidence (factual, 
judgmental, misleading); its type of content (social practices, politics- 
government, history-culture, and geographic-economics); and its order of pre- 
sentation as organized by chapters • 

Procedures . The general procedures first require that the purpose of the study 
should be identified. Then, each message element of Information should be 
identified. And subsequently, each element should be classified within 
three categories: the Evaluative Load, the Supportive Evidence, and the Type 
of Content, all according to the order of each chapter. Each part of the process 
is defined below: 

A. Defining the Domain of the Analysis 

Before beginning the analysis. It Is necessary to carefully define 
the range of student attitudes the study is Intended to tap. For 
example, if the study is centered on the students^ attitudes toward other 
cultures, the particular aspects of these cultures under study will 
need to be well defined. In the China example given here, the study 
concerns the students' general attitudes toward the Chinese Gommxinist 
society; and more specifically, with aspects of Chinese social practices, 
politics, and beliefs. 

B. Identifying the Information 

An element of analysis is defined as an assertion or statement. It may 
be either a simple sentence (i.e., subject and predicate) or a part of 
a compound sentence which relates a proposition, an idea, an issue, an 
argument, etc. to the specific domain of the study. 

C. Classifying the Information 

1. The Evaluative Load is specifically defined as: 

H positive information : information which has a favorable value in 



The other textbook was Afro-Asian Regional Studies , Allyn and Bacon, Inc. 
(1970), sections on AFRICA: SOUTH OF THE SAHARA ; and EAST ASIA: CHm, JAPAN , 
KOREA . This text is used in grades ten through twelve. 
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the American society; words and their associates which are 
written within a favorable context for the student (i*e*^ words 
of either positive or negative value which are given as 
favorable information within the context of the material); 
and statements or questions which call for a favorable response; 

L negative information : values unacceptable or questionable in the 
American society; words with unfavorable connotations or within 
an unfavorable context; and statements or questions which call 
for an unfavorable response; and 

neutral information: information which cannot be classified as 
either favorable or unfavorable; information or a task which 
requires noncommltal judgments; transitional or connective 
statement (s) which lead the reader into a state of indifference; 
and information which provides the learner with no choice or 
interpretation J either positive or negative. 

For an example of elements of information which are classified according 
to the Evaluative Load, see Passage 1 and Table A for an explanation of this 
task« 



Insert Passage 1 



Insert Table A 



2« The Supportive Evidence is specifically defined as: 

F factual statements: information based on objective observation 
empirically verifiable (e»g», statistical data, references to 
dates 9 names y and sources of information); 

J judgmental statements : information based on subjective opinion 
which is difficult to verify empirically (e.g,^ value statements, 
causal inferences, etc«); and 

M misleading statements : misuse of factual or judgmental statements 

by providing one^-slded arguments, selected contexts in which incidences 
are presented or neglected, ambiguous statements (e«g., contrived 
dialogue within an authentic situation), and Inaccurate information* 

In Table A, the Supportive Evidence indicator for each clement of the 
analysis is identified as factual statement (F), judgmental statement (J), or 
misleading statement (K) . 
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PASSAGE 1 



China was a land of peasants ^ The average amount of land 
per peasant before the ComnauniBt revolution was less than four 
acres. Peasants used farming techniques and tools that were 
centuries old. Peasants' wives pulled the plows* All planting 
and harvesting was done by hand. Only the richest Chinese family 
could afford to own animals to help them work or to provide food. 
Animals ate more grain than they were worth. 

Peasants were infected with all sorts of diseases and para- 
sites that took away their strength and killed them at early ages. 
The first disaster a flood, a droughty heavy winds and 
peasants were faced with famine and death. To add to the diffi* 
culties of life, peasants were illiterate and superstitious* They 
had little contact with other villages. In most cases, they were 
born and lived and died in the same village. 

The village itself was a collection of mud huts with few win- 
dows and little air. In the huts, farmers kept their tools and 
allowed whatever animals they might own to share the hut with 
their families. The hut had dirt floors, usually covered with 
filth. 

The landowner, the moneylender, and the government official 
also lived in the village. Each of these people managed to use the 
peasants for his own purposes. Some peasants would work on the 
land of the landowner for a small share of the crop. The money- 
lender loaned money or seed to the peasants at huge interest 
rates. The government official took bribes in addition to taxes. 
The peasants were left with almost nothing from their work 
(VGICES OF EMERGING NATIONS, pp. 122*124). 
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BEST COPY AVAIUBLE 



TABLE A. 



EXAMPLE OF DATA SHEET FOR INFORMATION-ANALYSIS 
UNIT XllI, VOICES OF EKERG1N6 NAIIONS, Section II, GHIHA 



NATURE OF INFORMATION 





liEUTRAL <N) 


OTGATIVE (t) 


POSITIVE (H) 


PARAGRAPH; ^ 
1 


SP RICHEST CHINESE FAMILY 

could afford to own aniiDals 
to help them work or to 


G/E CHINA PEASANTS 

was a land of peasants <F) 
G/E average amount of land per 

peasant before the Connunii 

revolution was less than 

four acres (M) 
G/E fanning techniques and too; 

that were centuries old(F) 
SP peasants* wives pulled the 

plows(M) 
SP all planting and harvestinj 

were done by hand (?) 
G/E CHINESE LIVESTOCK 

ate more grain than they 

were worth<J) 


t 
s 

; 


2 




SP CHINA'S PEASANTS 

infected with all sorts of 
diseases and parasites (F) 
took away their strength at 
killed them at early ages(l 
the first disaster. and 
peasants were faced with 
famine and death (F) 
were illiterate and super- 
stitious(J) 

had little contact with 
other villagers (?) 
were born, lived and died 
in the same village(F) 


\d 

■) 




>■ — ■ 


SP CHINESE VILLAGES 

a collection of mud huts w 
few windows and little air 
in the huts farmers kept t\ 
tools and. • ^animals (M) 
huts had dirt floors usual 
covered with filthfM") 


Lth 
(M) 
leir 

y 


4 


Sr CHINESE VILLAGES 

landouncr^ the moneylender, 
and the government official 
also lived in the village(F) 


SP CHINESE VILLAGE LEADERS 
each of th-^.se people. . .usei 
the peasants for his own 
purposes O) 

some peasants would work o 
the land of the landowner 
a small share of the crop 


1 

n 

for 
(F) 
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BEST COPY AVARABLE 



UNIT Xin, VOICE!.,., CKIKA 
PAGE 122 



NATURE OF INFOKMATION 



PARAGHAFH 



NEUTRAL <N) 



G/S SUBSISTENCE LEVEL 



Whut is the meaning oftF) 



H/C :HIMS£ varlords 

'ind OAit what they were and 
iov th«y affected Chinese 
evelopment(F) 



SP ^ EASAOT LIFE 

t orapare peasant life in 
; ^utbern China ^th peasant 
1 .fe in northern China in 

t e 18005(F) 



NEGATIVE (L) 



POSITIVE (H) 



SP CHINESE VILLAGE LEADERS (Cont*) 
DOney lender loaned money or 
eeed to the peasants at huge 
interest rates (J) | 
government official took bribes 
in addition to taxes(H} | 
pe«sants were left with almost 
nothing from their work (J) 



SP ILLITERACY/SUPERSTITION 
How do they add to the 
difficulties of UfeMJ) 



SP CHINESE VILLAGE LEj^ERS 
Why were the landowners, 
moneylenders ) and government 
officials allowed to take 
advantage of the peasants? <M) 



G/E £ INjgSE VILLAGE 

D: aw a Chinese village as yhu 
ink it would have looked (J) 



SP PHOTOGRAPH : Chinese Women 
Farm Workers (F) 



ERLC 



00081 



BEST copx mum 



mu XI n, VOICES.,., china 



PAGE 124 




NATURE OF INK)RHATION 




PARAGRAPH: 
1 


NEUTRAL (N) 1 


NEGATIVE (i) 


POSITIVE (W) 




SP CHINESE PEASANT LIFE 

productivity in China was 
often below the subslstenc 
level U) 

this waa the condition of 
90 percent of the Chinese 
people right into the 1900i 






SP PICTURE^ r,o caption{F) 







Each element of infcttnation la recorded in one of the cella defined 
by the Evaluative Load (N,L,H) and by Materials (Paragraph in Text-- 
nunibers; Que3tlon-«*small case letters^ and/or Plcturea^includlttg 
tnaps and graphs* For example, if negative infomation Is presented 
in the first paragraph^ such Information will be recorded under 
paragraph 1 (Material) and negative (Evaluative Load). To provide 
the reader with a way to identify each element of analysis in the 
Table > the first word of each unit is underlined. 
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3* The type of Content is based on a combination of areas of knowledge and 
disciplines which influence social studies curriculum, such as anthro- 
pology, political science, economics, etc« This category la defined as: 

SP social practices : information about family, role and status 

structures, with special emphasis on group and people relationships* 
This infonnatlon includes educational, religious, and other social 
behaviors; 

politics and government : information about the political structures 
ve.g^, town councils, political leadership, governmental policies, 
etc.); 

H/C history and culture : Information iiihlch deals with traditions^ 

ideals, beliefs, and events inherited from the past (e.g., religious 
and philosophical ideas, historical events, historical personalities, 
etc«); and 

G/E geography and economics : Information which examines the geographical 
and economic factors (e^gn, population, land resources, communications. 
Industry, etc.)* 

In Table A, the Type of Content for &ach element of the analysis is 
Identified as social practices (SP), politics-government (P/G), history-culture 
(H/C), and geographic-economics (G/E). 

D. Tabulating the Information 

To find the quantity of information in each one of these categories, the 
number of elements in a cell Is tabulated. In Table B, a cell is defined 
by the four factors: Material, Type of Content, E«^idence, and Evaluative 
Load« The data from Table 1 Is used to give an example of this tabulation 
procedure* 



Insert Table B 



Selection of Materials . Although this particular study was based on a 
seventh grade social studies textbook, the information analysis procedure lends 
itself to any grade level or social studies content area. It is specifically 
designed to handle a variety of content treatments* for example, this analysis was 
expanded to Include a unit on Africa within the same textbook In order to 
compare the significant findings • 

Design for Information i^alysls ^ The Information analysis design Is a 

3x3x3x3x24 full factorial, between elements design. The Independent variables are: 
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TABLE B, 



DATA SHEET 



TEXT: VOICES OF EMERGING NATIONS CHAPTER XIII 

UNIT: CHINA 

TEXT FACTUAL JUDGMENTAL MISLEADING 



r 

1 TYPE 


NEUTRAL 


NEG. 


POSITIVE 


NEUTRAL 


NEG. 


POSITIVE 


NEUTRAL 


NEG. 


POSITIVE 


SP I 


1 


7 




I 


7 






4 




P/G 2 




















H/C 3 




















G/E A 




2 






2 










T» 


1 


9 


0 


I 


9 


0 


0 


4 




QUESTIONS 


SP I 










I 






I 




P/G 2 


1 


















H/C 3 


1 


















G/E 4 


1 






I 












T. 


3 


0 


0 


1 


1 


0 


0 


I 


0 
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KIND LEVEL EXPLANATION 



Evaluative Load (E) 


3 


neutral, negative- positive 


Supportive Evidence (S) 


3 


factual, Judgmental, misleading 
social practices, politlcs-gov* t, 
his tory-cul ture , geo-economics 


Type of Content (C) 


4 


Kind of Material (M) 


2(3) 


text, questions 


Order of Information (0) 


2A 


order of units 



As the dependant measure , the total score per cell Is used. Within each 
Unit^ one point is given for each el^nent of the analysis in a given cell in 
the design, the total score of a specific cell is the sum of the elements 
contained In it. 

Using analysis of variance and orthogonal contrasts^ the following 
questions can be asked of the data: 

1. Are the differences between Evaluative Loads statistically significant? 
More specif icallyt (a) in this particular textbook is there significantly 
more negative information than neutral or positive informatlonj and (b) 
is there significantly more positive information than neutral information? 

2» Are the differences between the Supportive Evidences statistically 

significant? More specifically, (a) is there significantly more factual 

Information than judgmental and misleading information?; and (b) is 

there significantly more judgmental information than misleading information? 

3. Are the differences between the Types of Content statistically 
significant? More specifically, (a) is there significantly more 
geographic-economic information than all the other types?; (b) is there 
significantly more political information than social practices and 
history-cultural information?; and (c) is there significantly more 
social practices information than history-cultural information? 

4» Are the differences between the Kind of Materials statistically 

significant? More specifically, is there significantly more text material 
than others? 

5* Are the differences between the Order of Information (U*^its) statistically 
significant? 

Results* An analysis of variance was run to assess the effects of the five 
factors (Load, Evidence , Content , Material , Order)* Table C gives the analysis 
of variance results. In general , for the main effects: (a) there Is significantly 
more negative information than neutral or positive information (Figure a, 
p^.OCl); (b) there is significantly more judgmental evidence than factual or 
misleading information (Figure b, p^.OOl; and (c) there Is significantly more 
political-governmental content information than all other types of Information 
(Figure c, p^.Ol). 
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Insert Table C 



Insiart Figures a^b^c 



Several Interesting interaction effects are found t (a) there la 
significantly more negative information across the chapters for judgmental 
information than factual or misleading information (Figure e, p<*001); 
'b) there is significantly more negative information concerning Chinese politics- 
government than positive or neutral information (Figure g» p<:*^l); (c) the 
information tends to be significantly more judgmental and misleading for social 
practices and politics-government than for history-culture and geographic'- 
economic information (Figure g^ p<:^01)j (d) vhen looking at text material, the 
data suggests that all Information on China in this textbook tends to be negative 
or positive rather than neutral; there is more highly negative judgmental* 
misleading information than negative factual Information; and there is more 
moderately positive judgmental-misleading Information than positive factual 
information (Figure h, p<:»001)* 



Insert Figures e^f^g^h 



In short, the findings shov more negative, judgirental, and misleading 
information, particularly for content dealing with Chinese politics-government* 
Also, there was limited factual information concerning Chinese social practices* 
This result is interpretable in view of the fact that ordering of the chapters 
within the China unit makes a slight difference, that is, (10 several chapters 
d^al with case studies which perpetuated judgmental and misleading information; 
(2) there was a higher frequency of inforffiation dealing with politics- 
government which tended to be negative in nature; (3) any positive InfonDation 
was usually counterbalanced by negative information in concluding remarks at 
the end of the chapter or as found as an effect of order of subsequent 
chapters; and (A) the authors chose to judge China and her people on how close 
they came to approaching the 'standard' Anglo-American norms 



^In Table D. of Appendix A are presented the frequency means and frequency 
percentages for each of the variables «^lch support the above statements. 
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TABLE C. 



ANALYSIS OF VARIANCE FOR IMlIi 




UN t UKIIA 1 LKJa 


AUAT VQT'J ^ 




df 


MS 




EVALUATIVE LOAD (E) 


2 


9.0 


12.2*** 


SUPPORTIVE EVIDENCE (S) 


2 


14.5 


19.7*** 


CONTraT TYPE fC^ 


3 


5.6 


7.5** 


I^TND OF MATERIAL fM^ 


1 


60.8 


82.2*** 


niiriPR OF 1NF0R14A110N f UNITS ^ 


23 


2.2 


3.0** 


V V 

£» A w 


4 


3.5 


4.7** 


E X C 


6 


3.9 


5.2** 


F V M 

IL A *^ 


2 


40.8 


55.2*** 


E X 0 


46 


1.9 


2.5** 


S X C 


6 


3.3 


4.4** 


C X 0 


69 


6.7 


9.0** 


M X 0 


23 


2.2 


3.0** 


E X S X M 


4 


4.5 


6.1** 


E X C X yi 


6 


2.4 


3.2** 


E X C X 0 


138 


1.4 


1.9** 


E X M X 0 


46 


1.4 


1.9** 


G X M X 0 * 


69 


2.8 


3.8** 


E X C X M X 0 


138 


1.9 


2.5** 


K X S X G X M X 0, Error Term 


276 


.7 





^ Only slj?nificant sources are reported^ 
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Figure a. 

Percentage of the average frequency means for the 
evaluative load ( +» N, denoting an element as either 
negative, positive, or neutral in value). 
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(J) 



1" 



SUPPO.- " EVIDENCE 



Figure b. 

Percentage of the average frequency means for 
supportive evidence (J, F, M, denoting an element 
as either judgmental, factual, or misleading In va 
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POL SP H/G G/E 

TYPES OF CONTENT 



Figure c. 

Percentage of the average frequency means for the 
types of content (POL, SP, H/G, G/E, denoting an element 
as either of poll tics -government, social practices, 
history-culture, or geography-economics). 
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I I I 

(-) C+) (N) 

EVAUJATIVE LOAD 



Figure eg 

Percentage of the average frequency means 
for the Interaction between evaluative load +, II, 
denoting an element as either negative, positive or 
neutral In value), and supportive evidence (P, J, M, 
denoting an element as either factual ^ judgmental, or 
misleading) . 
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POL SP H/C G/E 

TYPES OF CONTENT 



Figure f. 

Percenta-je of the average frequency means for 
the interaction between evaluative load (-, +, N, 
denoting an element as either negative, positive, or 
natural in value), and types of content (POL, SP, H/C, 
G/E, denoting an element as either of politics- 
government, social practices, history-culture, geography 
economics) , 
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SUPPORTIVE EVIDENCE 



(J.M) 



1^ 

o 

o 



at 



.AO. 
.30. 
.20. 
.10. 




POL 



— T- 

SP 



I' "" 

H/C 



"g/e 



TYPES OF CONTENT 



Figure g. 

Percentage of the average frequency means for 
the interaction between supportive evidence (J and M, 
denoting an element as composed of Judgmental and 
misleading information or factual information) and 
types of content (POL, SP, H/G, G/E, denoting an element 
as either of politics -government, social practices, 
history-culture, and geography -economics information). 
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(F) (J,M) 
NEUTRAL 



(F) (J,W) (F) <J,M) SUPPORTIVE EVIDB^CE 
POSITIVE NEGATIVE EVALUATIVE LOAD 



TEXT MATERIAL 



Figure 

Percentage of the average frequency means for 
the three-way Interaction hetveen supportive evidence 
(F, J and denoting factual and the coniblnatlon of 
judgmental and misleading information) by evaluative 
load and text materials 
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Discussion , This infonnatlon analy Us can be quite useful as a technique for 
analyzing social studies currclulum materials. It provides the curriculum 
developer and evaluator with specific InforiDatlon concerning the amount of 
evaluative load and the use of supportive evidence, which Is contained in a 
given text book within a specific chipter of study. It also offers the means 
of judging how statistical significance of the inferences can be drawn from the 
data. Finally, it can generate basejine data that, for future studies, permit 
the prediction of: (a) how these materials are likely to affect student attitudes; 
(b) which teaching procedures are more adequate if one Is to use these 
materials; and (c) which changes and :ue5 are to be inserted in the social 
studies textbook. Perhaps, more Impo'tantly, it could serve as a training 
device/ technique for tecchers in asseisslng the load and evidence factors of their 
ins true t ional materials • 
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SECTION II 



THE APPLICATION OF INFORMATION INTEGRATION 
■mECRY TO SOCIAL STUDIES MATERIALS 



In this section, the authors will discuss the results of an experiment 
co-»ducted to isolate and quantify the effects of social stusuies textbook 
information on student attitudes. 



Introduction 



Information integration theory has recently been applied to the Investigation 
of attitudlnal effects of prose materials (Anderson, ''973, Kaplan and Kemmerick, 
1972; Sawyers and Anderson, 1971). In these studies. It was postulated 
that by manipulating the attitudlnal value or evaluative load of a message 
according to Its degree of favorableness and the contextual load of Information 
(for example, the degree of favorableness of the number and ordei of the 
message), it is possible to account for how a person evaluates and processes 
informatlcn. 

In one example, Anderson (1973) sought to identify how subjects form 
attitudes about U.S. Presidents, He found that a per80n*s Impressions are a 
function of an accumulation of favorable messages. That is, the addition of the 
amount of favorable information will increase the favorableness of the response. 
In the Kaplan and Kemmerick (1972) study concerned with jurors' judgments, the 
evaluative load again was found to function linearly. Thus, these researchers 
examine the cor^notative dimensions of information. 

The main focus of the present study is to extend the theoretical work Ir. 
information integration to prose materials in the social studies. Since In 
social studies materials, the elements of Information presented include ^ 
judj>mentB, facts, and cuJtural perspectives. It can be assumed that a l«arner*s 
value structure is subetantJally attributed to the integration of these 
pieces of information over time. 

With the application of a fractional factorial design, the linear model 
was further tested by introducing two subject variables and three moderately 
complex contextual factors in addition to the manipulation of the evaluative 
load. The two subject factors are the stated entry attitude of the subjects 
and the reading achievement levels of the subjects. The contextual factors Include 
the supportive evidence (the factual or judgmental quality of the paragraph), 
the content of the paragraph, and the type of country described in the paragraph. 
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\Ji^ predicted that the degree In the change of Impression is linearly 
attributable to the load of positive or negative information of four paragraphs « 
For instance^ if the subject has a positive entering impression about a given 
country and is presented with three paragraphs containing positive information 
and one paragraph containing negative information (PPPK), it can be predicted 
that his resultant impression will still be slightly positive • If the subject 
has a positive entering impression about a given country, but he reads four 
paragraphs containing negative information (II1INN)> it can be predicted that his 
resultant Impression will be negative. 

It was also possible that the quality of the supportive evidence, factual or 
Judgmental information, might Interact with its evaluative load. In this case, it 
was hypothesized that if the subject has a positive entering impression about a 
given country and is presented with a paragraph jAiich has a positive load and 
factual information, his resultant impression will be strongly affirmed; or if 
the subject has a positive entering impression about a given country and is 
presented with a paragraph which has a positive load and Judgmental information, 
his overall impression will be affirmed but to a lesser degree than with factual 
information because judgmental information can be assumed to be less credible. 

Further, the contextual effects which pertain to subject matter content 
(chat is, content areas and countries) were predicted to significantly interact 
with the evaluative loads of a passage set. Finally, it was thought that the 
read:fng ability of the subjects would significantly affect their ratings on 
the paragraphs. 



Method 



Subjects^ In June 1973, thirty- two graduating eleventh grade students participated 
in this study, ^ These students were suburban, ^^middle class" white Americans 
enrolled in social studies classes which focused on the study of toerican 
institutions. The subjects were asf^igned to experimental conditions according 
to sex and reading achievement scores. All subjects were paid four dollars for 
a single^ two hour session* 

Materials^ The materials used in this study were paragraphs abstracted from 
numerous currently used social studies textbooks and other social studies 
supplementary materials. In the selection of these materials, a special effort 
was made to represent the information that is actually transmitted in the social 
studies classroom. 

Paragraph Construction^ From these materials, 256 paragraphs were constructed 
to fit the experimental conditions specified by a fractional factorial design* 
The first step toward the construction of these paragraphs was to control 
for possible stereotypic perceptions of information related to particular 
kinds of country. Two factors were assumed to be Instrumental to the formation of 



*The authors wish to acknowledge the cooperative efforts of Homestead High 
School, Fremont Union School District, Cupertino, California, its principal, staff 
and students for providing the assistance needed to Implement this study. 
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stereotyped impressions. These factors art the geographical ^*>'^^'f ^ 
country (European countries and Asian countries); and the degree «f 
SeveWt of the country (modern or emergent). The four cells 'i^ff ^^^^^^^^^^ 
two two-level factors call for the following kinds of countries: (1) European- 
modern country; (2) European-emergent country; (3) Asian-modern country; and 
(4) Asian-emergent country. Consequently, for constructing the Paj^S^^P!^^'/^^ 
following four countries were selected: Britain, Spain. Japan, and Mainland 

^^^^^Social studies materials were analyzed using a content analysis technique 
devised by the first author (Rotzel. 1972). As a result of this analysis, the 
followinR four content areas were identified: geography-economics since l^^tS, 
Mstory-Luure prior to 1945. social practices since 1945. and politics-government 
since 1945. The second step then in the construction of the P*"8^*P^* J^.^.^! 
control for possible effects of the subjects' Impressions regarding particular 
content areas. These four content areas were included as two two-level factors 
in the fractional factorial design. Thus, sixteen paragraphs were selected 
for each content area within each country, i^^j 
The third step was to control for possible effects of the evaluative load 
of information (positive or negative) and the supportive evidence for this 
information (judgmental or factual). The evaluative J^J^^ ;'2\nJrRt^^^^^ 
criteria tho \t to be standard American values as established in the Resetter 
s^idy (BaJer and Rescher. 1969). The four cells defined by these tvo two-level 
factors allowed the construction of the following combinations of P^^^graphs. 
(1) positive-judgmental paragraph, (2) positive-factual paragraph, (3) negative 
judgmental paragraph, and (4) negative-factual paragraph. 

One paragraph with a positive evaluative load crossed with judgmental 
evidence and another with a negative evaluative load ^"^^^^.^^^^ 
evidence presented here will illustrate the general character of the paragraphs. 



CHINA, Nigitivi-Factaal Nragnph 



China's jfM. nationBi product m?) v«« •PProxImitJy $120 b.H,ofl .n 
income was onlv $146 conpartil the Unitad Statat of $5,000 per capita «d 1h» U.S.S.R. ^l^^'^^^'^f'^^ 
One applanation o1 thi, lo« incom« level i, the manner in ^ich the procea ol lave Inj .he ""j^^^^^^ 
Chinaie people hM been accompliihed by a leveling down of the status and ^^^^ 
According to Chinese governmtnt sources, monthly wages in "rt»n 1 11^ .^^^^^^^ 

$14 to A $45). In factories, wages are fixwl in eight grades Kccrding to skill, length '^^^^^^^ 
reliability. Only a relatively few technicians, managers, and senior officials get salaries ajbstanttaJly higher than $45. 



JAPAH, Positivf-JudgmanttI Parag^ph 

The Japanese probably value literacy more than any Western nation. The number of titles that the Jf>?«ne« 
publishing industry turni out every year i, among the highest in the world Japan's most ^J^'V-^^B-f j^^^^^^^^^ 
weighty volumes f Had with amaiingly diversified, sophisticated material. Newspaper circulation m Jepan "jw^i «io^ 
of all European countries. The Japanese educational system deservw most of the credit for making the people m th« 
i$land na!ion jo a¥«r» of the woMd they live in. 



To control for the degree of reading difficulty of each paragraph, a 
readability study was conducted. Three readability formulas were applied to 
each paragraph (Aukerman, 1972; Dale and Chall, 1958; and Fry, 1969). No signifi- 
cant systematic differences (p^.05) were found according to the design factors 
of country and content areas. 
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Proosdupe, Before the test session started, subjects were assigned to their 
respective test conditions defined by the fractional factorial design. That 
is, eight students were assigned to each cell of the design defined by the 
different factors used in the construction of the paragraphs. These eight 
subjects were selected according to their reading achievement (high or moder- 
ate) and their sex (male or female), so that two students were assigned to 
each one of the four cells of thase two two-level factors. 

After each subject was assigned to his appropriate cell, he was given a 
color-coded three-ring notebook which contained the specific test instructions 
and materials for that cell. Subjects were given several tasks before the 
actual experiment. First, the subjects completed an entering rating scale 
designed to assess the subjects' entry impression regarding eight countries. 
These countries were presented in alphabetical order: Argentina, Britain, 
China, France » Japan, North Vietnam, Spain and Thailand. The subjects were to 
project their overall impression about each country by rating the country using 
a four-point scale from highly positive to highly negative. Note that four 
countries, not included in the study (Argentina, France, North Vietnam, 
Thailand), were selected so that they would match the locational and techno- 
logical characteristics of those countries included in the study (that is, 
Britain- France, Japan- Thailand, China-North Vietnam and Spain-Argentina) ; The 
stated entry attitude of the students toward Britain, Spain, Japan, and China 
was later used as one of the between subjects far.tors in the final analysis. 

Second, the subjects perfotumd a warm-up task with two sets of passages 
similar to the actual experimental passages. After the warm-up session, the 
subjects then were asked to begin to read the first of the sixteen sets of 
four paragraphs. After each paragraph, subjects were told to judge whether or 
not each paragraph included judgmental or factual information on the four point 
Llkert-type scale, "1" for highly factual and "A" for highly judgmental. When 
the subject had completed each set of paragraphs, he was asked tu rate (1) 
his overall impression for the given country (general impression measure) , (2) 
his Immediate impression for the given content area (specific impression 
measure), and (3) his present inclination for living in the given country for 
a period of four years (applied impression measure). A Llkert-type scale from 
1 to A was used to measure his stated impressions. To insure that the subject 
was carefully reading each paragraph, two true/false comprehension questions 
were given after each set of four paragraphs. The questions were randomly 
selected from each paragraph in a set. There were no time restrictions. 

Experimental Design, A one-half fraction design with six between subjects, two- 
level factors was used for controlling possible effects of subject and order 
of presentation variables. The six, two-level factors were: sex of the subject 
(male or female), reading achievement of the subject (high or moderate), and 
four two-level factors to block for the order of presentation of the countries. 
Thus, order of presentation of countries was confounded with blocks (groups of 
subjects). 

A one-sixty-fourth fraction design of twelve with subjects, two-level 
factors was sued to assess the effects of country, its geographic location and 
level of technological development, content areas, evaluative load, and supportive 
evidence. The twelve two-level factors were: geographical location of 
countries (West: Britain, Spain; Asia: Japan, China); technological development 
of countries (Modern: Britain, Japan; Emergent: Spain, China); content areas 
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with four levels (geographic-economic, history-culture, social practices, 
politlCB-government) ; evaluative load for each set of four levels (geographic- 
economic, history-culture, social practices, politics-government); evaluative 
load for each set of four paragraphs with two levels (positive and negative 
information); and supportive evidxjnce for each set of four paragraphs with two 
levels (Judgmental and factual evidence). 2 



Results 



In this experiment, the three dependent measures (general impression, 
specific impression, and applied impression) were analyzed separately using a 
factorial analysis of variance. The significance tests for almost every design 
factor were similar across the three dependent measures. Consequently, the 
subjects' rating scores in each of the three measures were added to form a 
fourth measure (combined impression). The results of this fourth measure will 
be reported in this paper. 

The most relevant finding was the significance of the evaluative load 
(See factor L in analysis of variance Table 1) . This factor wat specifically 
tested for linearity using polynomial orthogonal contrasts. It was found that 
the number of paragraphs containing positive load linearly affect the degree 
of favorableness of the subjects' impressions (p^.Olj. No significant 
quadratic or cubic effects were found. 

The linear function in this case indicates that there is a comparable amount 
of increase in favorableness towards a country for each positive paragraph 
Included in a set of four paragraphs (See Figure 1). For example, if the four 
paragraphs are negative, the subjects* average impression for the country will 
be negative; when one positive parasraph is added to three negative paragraphs, 
the average impression for the country is still negative; when two positive 
paragraphs are added to two negative paragraphs, the average impression for 
the country is unchanged: when three positive paragraphs are added to one 
negative paragraph, the average impression for the country is positive; and when 
four paragraphs are formed and no negative paragraph remains, the average 
impression for the count"ry is more positive. Subjects seem to build up or 
accumulate and integrate favorable information or unfavorable information. Thus, 
when a paragraph projects a highly positive load, the subject, in turn, forms 
a highly positive impression. 

Significant main effects were also found for contextual factors, such as 
technology of the country (p-<.01) and content areas (p^.Ol). For example, the 
two countries with modern technology were judged significantly more xavorably 
than the emergent countries. With regard to the content factors, the ratings 
for politics-government were significantly less favorable than the other three 

content areas. , 
the major interaction effect of interest, the interaction between contextual 
tactors and evaluative load, was four.i to be nonsignificant. It is Interesting 
to point out that this finding is similar to that of Anderson (1973). 

Significant main effects of subjects' entering impression were also found 
(p^.Ol). It is not surprising to find that differences among subjects do 
exist before the subjects are given any type of treatment. Another potentially 
relevant interaction effect would have been on between subjects' entering Impression 



' If one were to use a full design for conducting this study, each subject would have had to read a total of 4,096 
paragraphs. This fractionalized design permitted the authors to control for variables by systematically selecting 25^ para- 
graphs siif h that each subject read a total of sixty-four paragraphs. 
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and evaluative load. This interaction was not found to be statistically 
significant. This suggests that the resultant impression and evaluative load. 
Th-»-s Interaction was not found to be statistically significant. This suggests 
that the resultant impression of a passage will be only a linear function of the 
evaluative load of the paragraphs. The values of the paragraphs have a 
cumulative effect upon the initial evaluative load of the entering Impression, 

In summary, the evaluative load factor can predict how the subjects 
integrate their predisposed entry impression with either positive or negative 
evaluative loads to form a resultant Impression. An additive model does 
account for a linear function of the number of positive or negative paragraphs pre- 
sented to the subjects. 

There is no statistical evidence which suggests that the supportive 
evidence affects the resultant impression of the subjects. That Is, while 
subjects were able to identify factual and judgmental Information contained 
m the paragraphs, they did not use this knowledge about the quality of the 
information for determining their resultant impression. While content areas 
and the levels of technological development for different countries were judged 
as significantly different, again subjects' overall impressions were not influenced 
by these factors, and finally, in postulating that subjects' reading achieve- 
ment would affect ratings, it was found that by using a strict criterion of 
p^.Ol, no statistically significant differences were found. 



Discussion 



TntegraHon Theory. The most significant finding in this study is the confirmation 
of previous studies that the subjects' resultant impression is formed as a 
linear function of the cumulative amount of the evaluative loading of information. 
Also, it was found that contextual factors, when adequately controlled as in this 
study, tend to have relatively little influence on the resultant impression of a 
passage. Thus an additive model of integration can predict how positive or 
negative information, in combination with the subjects' entry Impression, 
will either affect the intensity of the impression or change it. 

EduaatioK^l Irrplioaticns, This study offers empirical evidence for alerting 
educators to the importance of identifying the entry attitude of students, the 
positive and negative values present in materials, and the consequential need to 
teach students how judgments are m«»Je based on the amount of positive and/or 
negative information. 

The NCSS Curriculum Guidelines (1972) prescribe that curricula should seek 
"to establish 'value free' situations in order for students to discern between 
farts and opinions, objectivity and bias; and to point out the validating 
arguments supporting values and their specified consequences." In keeping with 
these objectives of the NCSS Guidelines, the authors underscore the need to 
(1) train teachers to use learning stiuations which will guarantee the balance of 
simultaneous presentations of favorable and unfavorable messages; (2) reform 
textbook and curriculum writing to avoid an inadvertent indoctrination due to 
the uncontrolled evaluative loads or the lack of simultaneously presented 
contrary viewpoints; and (3) teach students basic decision-making skills so they 
will be able to adequately assess the evaluative load of the message. 
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Mean impression rating scores of the Combined impression metture are a function 
of stimulus polariTY <PPPP. PPPN, PPNN, PNNN, NNNN, denoting a passage set 
hi3hlv positive, moderately positive, neutral, moderately negative, and highly nega- 
tive in value). 
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More specifically, this study suggests that for curriculum development and 
instructional strategies, it vould be desirable to encouragfe: 

teachers to — 

(1) identify the entry attitudes of the students (e.g., with the use of 
pretests or discussion sessions); 

(2) select materials which systematically identify the positive and negative 
values present in paragraphs or chapters of materials j 

(3) estimate whether the materials used will have a balanced or unbalanced 
effect on a student or group of students; and (for the unbalanced effect) 

(4) provide additional materials and encourage inquiry procedures, so that the 
student can make value choices based on balanced loadings of information on 
a given issue; 

textbook and curriculum writers to 

(5) make explicit the evaluative loads of each topic or chapter in instructional 
materials, and acknowledge the specific criteria used to define the favorable 
values; 

(6) present the pro and con arguments on given Issues simultaneously and 
systematically; 

(7) provide annotated bibliographical references which will identify positive 
and negative arguments on specific topics, in order that the effects 

of the materials are suited to the 'balanced' need of the student or group 
of students; 

(8) make suggestions of diagnostic-assessment exerclpes to be used to Identify 
student predispositions; and 

(9) begin to make predictions of the cumulative effect of the evaluative 
loads present in their materials; 

and student be taught to — - 

(10) dif ferentiate between positive and negative information; 

(11) make decisions on the basis of the amount and quality of positive and/or 
negative information, as well as the relevancy of the sources of information; 
and perhaps more explicitly, 

(12) predict, adapt, and produce change themselves in the context of continual 
modifications in values and accepted behaviors, without emphasizing specific 
criteria of judgments as 'good' or 'bad'. 

Relevant social studies literature has also pointed out the need for 
controlling the degree of favorableness of the message. For example, the 
California Task Force Report (1971) recommended that more positive Information 
about the contribution and role of the American minority groups be given equal 
space and emphasis in social studies textbooks. The Banks (1969) content analysis 
study suggested that the discrimination issues appeared more frequently in 
textbooks than the racial harmony and civil rights issues. He inferred that 
current textbooks emphasized more negative information than positive information 
about Black americans. Numerous new editions of civics, world problems. 
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and American history textbooks are attempting to present anthologies which 
seek to present two sides of an issue, pro and con (e.g., numerous positions 
on causation of a specific problem; primary sources differing in point of view). 
The purpose of this approach is to permit and encourage students to formulate their 
won conclusions. 

The empathy appeal is still another recent form of treatment found in 
textbooks which' deal with information about poverty, inner-city dwellers, 
minority groups, developing nations, and drugs. It is not clear, however, in 
any of these above examples, whether the loading of the information will or 
will not affect the learning process in a positive or negative way. The point 
to be drawn is that the evaluative load of content cannot be assumed nor inferred 
from the given examples. The evaluative loads of the message must be 
empirically tested. 

Results of the author information analysis of two social studies textbooks 
have shown that these texts do not adequately control for the context in which the 
message is presented. In most of the cases, one can conclude that it will be 
very difficult for the student to weigh the contrasts between positive and 
negative information without a balanced context. Inadvertently, textbooks load 
some chapters with positive information and other chapters with negative 
information. For example, a historical section at the beginning of a textbook 
might present information about Black Americans as poor, uneducated, and as 
institutionalized slaves during the pre-Civil War days; and in the politics and 
government section at the middle or end of the text, describe Black Americans as 
working toward integration and racial harmony. 

In general, social studies teaching practices do not include a careful 
assessment test for the entering impression of the students toward specific 
issues, the results of this study suggest that a s adent reading from this 
kind of textbook will tend to have a negative impression toward the historical 
events and a positive impression toward the political practices of the Black 
Americans. However, there is another factor that affects the student s overall 
impression, that is his entry impression. For example, if a student is 
negatively predisposed toward Black Americans, then the historical events 
section will strengthen a negative impression; and the information concerning 
racial harmony will have a small effect on the student^s impression. 

Thus, his overall imvfession toward Black Americans will be proportionate 
to the amount of positive and negative messages presented and then added to 
his entry impression. It also follows that the student with a positive entry 
impression would be influenced negatively toward the historical information, and 
would be influenced more positively toward the socio-political practices, re- 
sulting in an overall impression dependent upon the amount of negative and/or 

positive information. , . , , 

The experimental research data is not yet sufficient to formalize a curriculum 
model which views the learner as the "integrator" of attitudinal impressions. 
However, the experimental findings continue to provide further evidence for a 
general information integration theory. It appears inevitable that social 
studies educators will need to account for the development of instructional 
materials and, especially, to show formal, experimental evidence of balance of 
totality of information about such topics as race, nations, political systems, 
historical events, and cultural perspectives. 
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Furtke7' Wo2'k. The research methodology used in this study also has important 
implications • While there have been many studies attempting to isolate curricula 
materials which are thought to affect attitudes (Fisher^ 1968, Litcher and 
Johnson, 1969; McDiarmid and Pratt, 1971), the methodologies of pre/post 
treatments or content analyses are incapable of accounting for what and how 
information Is processed to change or maintain an attitude* By using the 
fractional factorial designs, scales of measur^ent, and analysis of variance, 
the conditions under which information is processed (that is, how the subject 
combines messages to form an overall impression) can be explained by the 
manipulation of numerous factors. 

This study made a specific effort to measure subjects' entry impression, 
to systematically control for the amount of positive and negative information 
presented to the subject, and to control for the context in which the information 
was presented • Further exploration could be directed toward a detailed 
examination of more contextual factors such as pictures with text, critical 
questions with text, and teaching strategies* For example, picture dimensions 
(e*g,, concreteness, familiarity, pictures with or without captions) could be 
introduced. Another variant of this experiment's design could he to add longer 
paragraphs and /or include more paragraph combinations of passage sets of the 
evaluative load for looking at integration effects. 



THIS PAPER HAS BEEN TYPED AND REPRODUCED THROUGH THE FACILITIES OF THE SAN 
MATEO COUNTY OFFICE OF EDUCATION. NOVEMBER. 1974. 
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APPENDIX A 



FREQUENCY MEANS FOR INFORMATION ANALYSIS OF THE 
TEXTBOOK, VOICES OF EMERGING HATIONS , 
SECTION II ON CHINA, pages 8fi-157 
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APPENDIX B 



BIBLIOGRAPHY OF SOCIAL STUDIES MATERIALS USED 
FOR PARAGRAPH GONSTRUCTfON 
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HIGH SCHOOL SOCIAL STUDIES MATERIALS 
FOR EXPERIMENTAL STUDY 



Britain 

Arnstein, Walter . Britain- -Yesterday and Today. 1830 to the Presen t. 
Lexington, Mass. : D. C, Heath, 1971. 

Belasco and Kavunedus. Our AVe stern l^eritage . New York: 
Cambridge "^ook Company, Inc. , 1970. 

Britannica Junior Encyclopedia . Volumn 5, 1969- 

Compton's Encyclopedia . Volume 7, 197 3. 

Harris, Kenneth. About Britain . London: Hodder & Stoughton, 1967. 
Huizinga, J. H. Britain . Gateshead: Oxford University Press, 1970, 
Kahn, Herman and Wiener, Anthony J. The Year 2000 . 1967. 
Osborne, John. Britain . New York: Time, Inc., 1967. 
World Book Encyclopedia . Volume 6, 1973. 

Yohi, Gahill, Gross, Gaitzner, Exploring Regions of the Eastern 
Hemisphere . Chicago: Follett, 1971. 

China 

Behind the Turmoil in Red China, U.S. News and World Report , Vol. 
71, October 18, 1971. 

Bell, Oliver. The Two Chinas . New York: A Divi si on of Scholastic 
Magazines, Inc. , 19 64. 

Boutwell, Clinton E. Voices of Emerging Nations . San Francisco: 
Leswing Communications, 1971. 

Chen, Juan. The Cutlook for China 's Economy. Current History . 
September, 1972. 



0U05O 



China Giant > The: Perspectives on Comrnunist China > Glenview, 
Illinois; Scott, Foresman and Company, 1967* 

Grain, Clark et al. Oriental World: Ocean World . New York: 
W. H. Sadlier, Inc., 1971. 

Durdin^ Tillman. Commune^s Barefoot Doctor is a Farmer, Too. 
New York Times , April 30, 1971. 

Durdin, Tillman. China After Mao: Serious Hazards Lie Ahead. 
U. S> News and World Repor t, October 18, 197 

Fair bank, John King. The United States and China . New York: The 
Viking Press, 3 969* 

Fessler, Loren. China , LIFE World Library, New York: Time, Inc, 
1973. 

Ford, Richard B. Tradition and Change in Four Societies: An 

Inquiry Approach . Holt Social Studies Curriculum, New York: 
Holt, Rinehart & Winston, Inc., 1968. 

Gayu, Mark. Who After Mao? Foreign Affairs , Vol. 51, No. Z, 
January, 1973. 

Israel, , Roemer, N. H. , and Durand, L. World Geography Today , 
New York: Holt, Rinehart & Winston, Inc., 1966. 

James, Preston and Davis, Nelda. The Wide World: A Geography . 
New York: The^ Macmillan Company, 1962, 

Jan, George P., ed. Government of Communist China . San 
Francisco: Chandler Publishing Company, 1966. 

Kolev^on, Edward R. East Asia: China, Japan, Korea . Afro- Asian 
Regional Studies. Allyn and Bacon, Inc., 1970. 

Kublin, Hyman. China . Boston: Houghton -Mifflin Company {Houghton 
Mifflin Social Studies Program - Regional Studies), 1968. 

Liu, William T. Chinese Society under Communism: A Reader . New 
York: John Wiley and Sons, Inc., 1967, 

The People's Republic of China: An Overview. Issues in Unite d 

States Foreipn Policy . Series No. 4 (presented in Social Educa -- 
tion, Vol. 37, No. 1, January, 197 3). 
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Prybyhn, Jan S. Foreign Aid: The Chinese Are Corning. Curren t 
History , September, 1971. 

Reed, James F. Eastern Lands . Boston,* Allyn and Bacon, Jnc 
1959. 

Richman. Barry M. Industrial Society in Communist China . New 
York: JLandon House, 1969. ~~ 

Schurmann, Franz and Schell, Orville. The China Reader; Com - 
munist China. Ne-vv Yoi k: i-andon iiouse. Vintage Books, 1967. 

Sno>v, Edgar. Aftermath of the Cultural Revolution. The New 
Republic . Vol. 164, April 10, 1971. 

Stravlianos, Leften S. and Hackett, Roger F. China: A Cultural Area 
in Perspective. Belmont, California: Allyn and Bacon, Jnc, 
1966. 

Swisher, Earl. Today^s Wor ld in Focus: China . New York: Ginn and 
Company, 1964. 

TerriU, Ross. The 800.000, 000: C Mna and the World. Atlantic 
Vol. 229, January, 1972, " ' 

Yohi, Cahill, Gross, Gaitzner. Exploring Regions of the Eastern 
Hemisphere. Chicago: Follett, 1971. 



Japan 



Behind the Consumer Boom. The Japan Times . June 21, 1970. 

Grain, Clark N. et al. Oriental World: Ocean Wor ld. New York- 
W. H. Sadlier, Inc., 1971. 

Fairbank. John, Reischauer, Edwin, and Craig, Albert. East Asia - 
The Modern Transformation . Boston: Houghton Mifflin Company 
19 65, ^ ^ 

Hunsberger, Warren S. Japan: Lessons in Enterprise . Area Studies 
in Economic Progress, Chicago: Scott, Foresman and Company 
1963. ^ ^' 
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Israel, S. , Roemer, N. H. , and Durand, L. World Geog-aphy Today . 
New York; Holt, Rinehnrt Winston, 1966. 

Japan's Export Surpluses, The Japan Times , June 9, 1970. 

Japan's Foreign Aid Program. The J.^pan Times , August 7, 1970. 

KolevKon, Edward R. East Asia: China, J:4pan, Korea . Afro- Asian 
Regional Studies, Allyn and Bacon, Inc., 1970. 

Kublin, Hyman, ed. Ja-pan: Selected Readings , World Regional 
Studies, Boston: Houghton Mifflin Company, 1968. 

Langer, Paul F. Japan; Yesterday and Today . Contemporary Civili- 
sational Series. New York: Holt, Rinehart Winston, Inc., 1966. 

McKeown, Robin S» , ed. Modernization in Japan. Asian Studies 

Inquiry Program, San Francisco: Field Educational Publications, 
Inc., 1969. 

Price of High GNP, The Japan Times , May 29, 1970. 

Seidensticker, Edward. Japan . LIFE World Library. New York: 
Time, Inc. , 1961. 

Welty, Paul Thomas. The Asians; Their Heritage and Their Destiny . 
3rd edition. New York: 3, B. Lippincott Company, 1970. 

Yohi, Cahill, Gross, Gaitzner. Exploring Regions of the Eastern 
Hemisphere . Chicago: Follett, 1971. 

Spain 

Anderson, Charles W. The Political Economy of Modern Spain : 

Policy- Making in an Aul ht)r itnrian System . Madison: University 
of Wisconsin Press, 1970. 

Beejon, Trevor. Spain: Still Totalitarian. The Christian Century , 
Vol. 88, Februnry 10, 1971. 

Britannica Junior Encyclopedia , Volume 13, 1969. 
Comptcn's Encyclopedia , Volume 19, 1973, 
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Kconomic and Soc i al Development Program for Spain . 1 9 64- 1 9 67 . 
Prepared by the Commission lor Economic and Social Develop- 
ment Planning, Presidency of the Government of Spain, Balti- 
more: John Hirini Press, 1965. 

Hills, George. Franco; The Man and His Nation . New York: 
Macmillan, 1967. 

Maigues, Gines M. Spain . Grand Rapids, Michigan: Fideler, 1959. 

Painton, Frederick C. Changing Cowrsf for Fa-snco's Spain. U. S. 
News and World Report . Vol. i>% November 16, 1970. 

Payne, Stanley. Franco's Spain . New York: Thomas Crowell, 1967, 

Thomas, Hugh. Spain . New York: Time, Inc., 1962. 

"Welles, Benjamin. Spain: The Gentle Anarchy . Frederick A. 
Praeger, 1965. 

Whitaker, Arthur P, Spain and Portugal: Continuity and Change. 
Current History , May, 1970, 

World Book Encyclopedia . Volume 18, 1973. 
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APPENDIX C 
2x2 DESIGNS FOR PARAGRAPH CONSTRUCTION 
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EXflERlMIirrAL STUDY ON SOCIAL STUDIES INFORMATION 



INTRODUCTION 

The p^rpote of this experimental study is to explore how students 
make sense of information from social studies textbooks and supplementary 
materials. Most high school social studies texts identify or emphasize 
certain viewpoints on issues by using pieces of either positive, neutral, 
or negative information. In addition, writers of social studies materials 
support their viewpoints by using either judgmental evidence (i.e. information 
that cannot be sys'^ematically observed or tested) or factual evidence 
(I.e. information which can be systematically observed or tested). Your 
task this morning will be to rate some paragraphs with respect to these 
factors: (1) positive ana negative infonaarloa, and (2) judgmental and 
factual evidence. 

You have each received a booklet. Please note at this time whether 
you have a number code on the front cover of your booklet. If you do not, 
please raise your hand and a proctor will check with you. No names will 
be identified with a booklet at anytime after the completion o,f the 
experiment. This study will not compare your scores with the scores of 
other students. Remember, this is not a test. We are interested mainly 
in your reaction to the content of each paragraph. Therefore, it is 
very important you do the best you can. 

OVERVIEW OF TASKS 

There are several sections to this study. Let us go over them 
briefly: 

(1) First you will fill-out an identification questlonaire; 

(2) Second you will do a word association task in which you 

" describe your position on a number of issues about foreign 
countries; 

(3) Third you will have two practice sessions; and 

(4) Finally, 3'ou will be on your own to do the tasks, with 
a refreshment break mid-way into the study. 

Are there any questions? 



TUiU^ THE PAGE 
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IDENTIFICATION QUESTIONAIRE 

Directions: Please fill-in the appropriate answers to the following 
questions: 



1. Your Sex: (circle) MAIE FEMALE 

2. last completed grade in high school: (circle) 11 12 

3. Have you studied a foreign language? (circle) YES NO 
If you answered 'YES', please ai^swer tbe following questions: 
3a. Which language (s)? List: 

3b, How many years have you studied the language (s)? 



4. Have you traveled abroad to a foreign country (e.g, Mexico, Prance, 
India) within the last five years? (circle) ^es NO 

If you answered 'YES', please list the countries: 



5. Are you a member of a social organization (e.g. school clubs. Scouts)? 
(circle) 

If you answered 'YES', please answer the following questions: 
5a. Which social group (s) are you a member of? 

name of social organization (s) 
5b. How long have you been a member? 



years of membership 



TURN THE PAGE 
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IDENTIFICATION QUESTIONAIRE: continued 

6. Are you a member of a religious organization (e.g. church, synagogue, 
Young Life)? (circle) 

YES NO 

If you answered 'YES', please answer the following questions: 

6a « Which religious group? List name of organization and activities. 



name of relleious croup (s) 



activities 



6b. Please write an estimate of the number of times you have participated 
in your religious organization (e.g. times you have attended church 
of Young Life meetings) during the last two months: 



number of times 



7. What political label do you usually identify with? 

Mark an 'X' on the line below which best indicates your general 
political views: 



1 2 
radical 



3 4 5 6 7 8 

liberal conservative reactionary 



WAIT UNTIL YOU ARE TOLD TO TURN THE PAGE 
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GENERAL IMPRESSION AND WORD ASSOCIATIONS 

DIRECTIONS: 

On each of the following eight pages, there will be a name 
of a different coxintry for you to give a general impression 
about and describe. Specificially , 

<1) You will be asked to rate your general impression about a country 
on a four-point scale from positive to negative. You will follow 
this procedure for all eight countries. 

Example 

How would you iLe^cxJbjp yjooir g<&a£i:al iaipr«fifiion about thu 
United States of America? 

Mark an 'X' in the space below which best indicates your impression. 



POSITIVE 



NEGATIVE 



1- indicates that your impression is HIGHLY POSITIVE 

2- -indicates that your impression is MORE POSITIVE than negative 

3- -indicates that your impression is MORE NEGATIVE than positive 
A--indicates that your impression is HIGHLY NEGATIVE 

(2) You will then describe that country by marking the list of words 
on the page. Let's take a look to see how this is done. Each 
pair of words forms a scale. 

For example, if you feel that the country at the top of the page is 
very closely related to one end of the scale, you should place a 
check mark as follows: 

cold X : : : i t :^ 

or 

cold : : : : :^ s X hot 

If you feel that the country at the top of the page is closely related 

to one or the other end of the scale, you should place a check mark as follows 

large : X : : : : : small 

or 

large ; ; ; : : X ; small 

If you feel the country at the top of the page is only slic htlv related 

to one or the other end of the scale, you should place a check mark as follows; 



good 



bad 



or 

good : :__ : X : : bad 

If you consider both sides equally related with the country at the 
top of the page, you should place a check as follows: 

honest : : ; X : *, : dishonest 



TURN THE PAGE 
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DIRECTIONS: continued on WORD ASSOCIATIONS 

The direction toward which you check, of course, depends upon 
which of the two ends of the scale seem most characteristic of 
the country you are describing. 

IMPORTANT 

(a) Place your check marks in the middle of spaces , not on the boundaries: 

„ NOT THIS 
THIS X 

: : X : : : i 



(b) Be yure you check ever:,' scale for every concept- -do not omit any. 

(c) Never put more than one check mark on a single scale. 

Do not spend more than a few seconds marking each scale. Your 
first impression is what we would like to learn about. 

The countries you will describe are listed below in order: 
ARGENTINA, BRITAIN, CHINA, TRANCE, JAPAN, NORTH VIETNAM, SPAIN, THAILAND 
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GENERAL RATING: 



BRITAIN 



How would you describe your general impression about BRITAIN? 

Mark an 'X' in the space below which best indicates your impression. 



POSITIVE 



NEGATIVE 



1- Indicates that your impression is HIGHLY POSITIVE 

2- -Indicates that your impression i5 MORE POSTTTVK than negative 

3- -lndicates that your impression is MORE NEGATIVE than positive 

4- -indicates that your impression i-s HIGHLY NEGATIVE 



WORD ASSOCIATIONS: 



BRITAIN 



FAST 


•m 

'« 






-* 




• 


SIMPLE 


• 


• 


• 






1 II 1 • 


UNSTABLE 


'* 
It. 


• 






• 


• 


FAIR 


• 

• 


• 


* 


• 


• 


• 


POOR 


• 








• 




WEAK 




• 


• 

1 • ■ - 


• 


* 




CLEAN 




• 


• 


• 


m 

», 


• 


PESSIMISTIC 


• 


• 
• 


« 




'to 
• 


II IB • 
~» 


LENIENT 


• 


It 


II*' 




• 

■1 II "•■ ■ 


• 

• 


PEACEFUL 


• 




m- m -r 


• 
• 


• 
• 





SLOW 

COMPLEX 

STABLE 

UNFAIR 

RICH 

STRONG 

DIRTY 

OPTIMISTIC 

SEVERE 

BELLIGERENT 
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APPENDIX E 



EXPERIMENTAL MATERIALS FOR SUBJECTS IN 

BLOCK IV 
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213 



Japan's tmperiaVistic interest in Korea (1910-1945) was chiefly for 
self-interests. During the thirty-five years that the Japanese ruled 
Korea, the people were not granted civil rights. For example, the freedoms 
of Koreans were sharply reduced. The Korean language was not allowed to be 
used. The people were conscripted into the Japanese army. All businesses 
of any importance were taken over by the Japanese. The Japanese further 
confiscated large amounts of natural resources and agricultural products 
from Korea to serve the domestic and military interests of Japan. 



MARK AN 'X' IN THE SPACE BELOW WHICH BEST INDICATES FACTUAL OR JUDGMENTAL 
EVIDEKCE. 



JUDGMENTAL | I 1 I J FACTUAL 

1 2 3 ^4 
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T.here have been major epochs of history when the Japanese did not 
readily adapt to Western (European) institutions and ideas. For example, 
during the 1600' s, Japanese leaders concluded that Christianity would upset 
the existing social and political order. The government forbid missionaries 
to enter Japan. Japanese converts were considered possible allies of anti- 
government, or Western invaders. They were ordered to renounce their faith. 
Those who refused were executed. Christianity was finally expelled from 
Japan during a revolt in the southern island of Kyushu. Thousands of 
Christians and their families were killed. As a result of these actions, 
the forces for Christianity in Japan were destroyed. 



MASK AN *X' IN THE SPACE BELOW WHICH BEST INDICATES FACTUAL OR JUDGMENTAL 
EVIDENCE. 



JUDGMENTAL 



I I I I I 



FACTUAL 
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Religion, in the Western sense of tlic -woTd, has been a ritual In Japan. 
It Is more a natural expression of the tea ceremony or flower arranging, than 
the ethical teaching of Western religions. Today religion is less important 
than ever. The Japanese people belong to mutually compatible Buddhist sects, 
yet there are seldom any strong feelings about religious affiliation. This 
applies also to the Shinto religion, which for the Japanese is more of an 
accepted ritual or formality than a religious faith. There exists in Japan, 
compared to Western standards, a spiritual void: a people without religion. 



MARK AN 'X' IN THE SPACE BELOW WHICH BEST INDICATES FACTUAL OR JUDGMENTAL 
EVIDENCE. 



JUDGMENTAL | I I I I FACTUAL 
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Some Japanese intellectuals studied tlic liak l>etween Christianity and 
the practice of democracy. As stated by Yoshino, an influential scholar 
In the 1920 's, "Christian belief, as it asserts itself in every aspect 
of society, is democracy." Christianity entered Japan again in the latter 
part of the 17th century as part of Western culture. Many of the intellec- 
tiuals who accepted it were concerned with Japan's task of strengthening 
the society and gaining equality with the West. Christianity was very 
popular in both urban and rural areas. 



MARK AN 'X' IN THE SPACE BELOW WHICH BEST INDICATES FACTUAL OR JUDGMENTAL 
EVIDENCE. 



JUDGMENTAL I I I I I FACTUAL 

12 3 4 
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IV, 2 

QUESTIOt^S ON JAPAN 



GENERAL RATING: 

1. How would you describe your general impression about JAPAN? 

Mark an 'X' in the space below which best indicates your impression. 

POSITIVE I I I I I NEGATIVE 

1 2 3 A 

1— indicates that your impression is HIGHLY POSITIVE 

2— indicates that your impression is MORE POSITIVE than negative 

3— indicates that your impression is MORE NEGATIVE " than positive 
A— indicates that your impression is HIGHLY NEGATIVE 

PARAGRAPH RATINGS : 

2. How would you describe your impression about the history and culture 

of JAPAN? ^ 4 

Mark an 'X' in the space below which best indicates your impression. 



POSITIVE 



I I I i I 



NEGATIVE 



3 How would you react to the possibility of living four years in JAPAN? 
Mark an 'X' in the space below which best indicates your impression. 



POSITIVE 



I I I I I 



NEGATIVE 



TRUE/FALSE QUESTIONS: 

CIRCLE the correct answer for each question. T is True; F is False. 

A. The Japanese curtailed the rights of the Koreans. T ^ 

5. The Japanese government has always encouraged freedom of ^ ^ 

worship . 
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APPENDIX F 

TABLES 2 THROUGH 10 AND FIGURE 2 OF ANALYSES 
OF VARIANCE FOR IvIAlN FACTORS (ANALYSIS I) 

This appendix presents Tables 2 through 10 and Figure 2, 
reporting the means and the first series of analyses of variance for 
the three dependent measures (General, Specific, and Applied Impres 
sions) as well as the relevant means for these measures and the 
Combined Impression measure of all the main factors in the design. 
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NNKN UNNP NNPP NPPP PPPP 

EVAUJATIVE LOADS 

Figure 2, 

Mean Impression ratitigs of Specif Ic, General, and Applied 
Impression measures as a function of stimulus polarity (NNIW^NNNP, 
NNPP,NPPP,PPPP, denoting a passage set highly negative, moderately 
negative, neutral, moderately positive, and highly positive in 
value)* 
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APPENDIX G 



TABLES 11 THROUGH 14 OF ANALYSES OF VARIANCE FOR 
CONTENT FACTORS (ANALYSIS II) 

This appendix presents Tables 11 through 14, reporting the 
second series of analyses of variance for the four dependent measures 
(General, Specific, Applied, and Combined Impressions) as well as 
the relevant means 1. r these measures for all content factors. For 
this second analysis, the data was reorganized to further investigate 
the effects of content as a contextual factor. Twelve contrast scores 
were generated for each of the four measures by averaging across 
blocks four sets of three contrast scores (i.e., by summing over all 
cells with the NNNN and/or NNNP combinations, the NNPP combina- 
tion, and the NPPP and/or PPPP combinations within each specific 
content subject matter). In Table 11 are presented the means of the 
averaged scores for content areas by passage sets of evaluative load; 
and in Table 12 analyses of variance results for the Combined Impres- 
sion measure are given. A test for the linear function of the contrast 
scores by content subject matter was made. A highly significant 
effect was found (p < . 01). Table 13 presents the analysis of variance 
findings for the three dependent measures (General, Specific, and 
Applied Impressions). Finally, in Table 14 are presented the means 
for the between- subjects factors of all the four dependent measures. 
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APPENDIX H 



TABLES 15 THROUGH 18 of ANALYSES OF VARIANCE FOR 
COUNTRY FACTORS (ANALYSIS III) 

This appendix presents Tables 15 through 18, reporting the 
third series of analyses of variance for the four dependent measures 
(General. Specific, Applied, and Combined Impressions) as well as 
the relevant means for these measures of all country factors. For 
this third analysis, the data was reorganized to- further investigate 
the effects of country as a contextual factor. Twelve contrast scores 
were generated in a similar mangier as in Analysis II. This time thr 
four sets of three contrast scores (NNNN and/or NNNP; NNPP; NPPP 
and/or PPPP) were averaged across blocks within each specific 
country. The averaged mean scores of all dependent measures for 
country factors are reported in Table 15. In Table 16, analysis of 
variance results for the Combined Impression are given. A test for 
the linear function of the contrast scores by countries was made, A 
highly significant effect was found {p< ,01). In Table 17 are presented 
the analysis of variance findings for the three dependent measures 
(General. Specific, and AppHed Impressions), Finally, in Table 18 
the means for the between subjects factors are given for all the four 
dependent measures. 
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